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(54) Editing of recorded material 

(57) An edit controller for controlling editing of re- 
corded audio and/or video material, in which temporally 
successive material clips of -a edited output material se- 
quence are represented by corresponding clip icons on 
a display screen, comprises cursor control means for 
providing user control of a cursor on the display screen; 
selection control means for selecting an operation to be 
performed by the edit controller in dependence on the 
current position of the cursor on the display screen when 
the selection control means is activated by the user; 
means for defining first and second display screen se- 
lection areas for each clip^icon, the first and second dis- 
play screen selection areas, each having a predefined 



position on the display screen with respect to a current 
display position of the respective clip icon; means, re- 
sponsive to user operation of the selection control 
means while the cursor is displayed within the first se- 
lection area associated with a clip icon for initiating re- 
play of the output material sequence from the start of 
the material clip corresponding to that clip icon; arid 
means, responsive to user operation of the selection 
control means while, the cursor 4s displayed within the 
second selection area associated with a clip icon for in- 
itiating replay of the output material sequence from a 
point within the material clip corresponding to that clip 
icon which is a predetermined time before the end of 
that material clip. 
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Description 

such as audio and/or video ed.t controllers. Q vjdeo sequen ces into a final 

, As an example, video edit '°"f l,e ^^^^ 
programme or part ol a programme. For example a 

linked together to form the composite have become available . These allow a user to view the source 

Recently, ""P*"^ and an "out-point" for each required sequence us.ng the 
sequences on a computer screen and to- j^ct an « P° or trackerba „. 

dra tlUl.anumMro, S ource video sequen^ 

device such as a hard disk. The source „ by the sequence being copied into the 

indicating where on a video tape that source ^^S^SC. represented by source jcons 20 in an upper 
computer-based storage device. The source wleo «™ * ± & ^ j^me "uset ; 1 ,.; 

area of the display screen. These source ^^^ T ^^^Z (or output) sequence. To view a - 

above, «*M* f^*^t^,S^rSi22T» Pa*" 1 * <*"» »«"'*•)<>' 

for the output edited sequence. ^ . h«..i,i«^iMm on the cliD icon 30A. then the whole of the portion A will 

ci e icon 30C. in »h«h case r.play vol* ■» V™*£~™ ° ol e Uded audio and/0, vidao material, Ml* 

on a display screen, the controller comprising: 

cursor control means for providing user ^J^^^^^cc^ in dependence on the 
selection control means tor select,^ , an operation to be Vg^gg^rt** means is activated by the user; 
current position of the cursor on the d,sp lay screen when £• * e ^™ ^ se- 
means for defining '^st and.second d^play^screen-se^ qt tne 

lection area haying a predefined f^^iSSXSSSLSm predefined, posit^wtth respect to a 
respective clip icon and the second display s Scfo Icon in the temporal replay order; 
current display position of the •"^^g^^^JSS the cursor* dispiayed within the first 

sT^x:^^ 

sequence. t ,- can be controlled as described above, if the user 

For example, while replay from the start of one of the «JJ"«P h reviously proposed system he 
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use a jog or similar control to replay just the closing seconds of the preceding clip. Both of these techniques are 
inconvenient for the user, who may be under time pressure to work efficiently (e.g. in a news-gathering editing envi- 
ronment). 

The invention addresses this technical problem of providing means for reviewing the edit transition between suc- 
cessive clips, by providing two distinct controls associated with each clip icon. If the selection control means (e.g. a 
mouse button, trackerball button or joystick button) is operated when the cursor is in a first area associated with a clip 
— icon, the whole of the-corresponding clip is-replayedr However r if -the cursor- is in a second area associated- withthat 
icon, only the closing seconds (or other predetermined amount) of the clip is replayed. In both cases, replay can then 
continue to temporally succeeding clips. 
■m Thus* by using the second area associated with an ieon (which may be-; for example* at the Tight hand edge of 
each icon, between that icon and the temporally following icon or at the left hand edge of the temporally following icon), 
the user can preview the edit transition from a point just before the end of that clip. 

The system is particularly convenient to use if the icons are arranged in temporal order along a. predetermined 
screen direction (e.g. from left to right). 

Prelerably the predetermined time may be set by the user. 

The invention will now be described by way of example with reference to the accompanying drawings, throughout 
which like parts are referred to by like references, and in which: 

Figure 1 is aschematic diagram of a display screen of an edit controller; 

Figure 2 is a schematic block diagram of ari edit controller and associated video storage apparatus; 

Figures 3a to 3c schematically illustrate source video files; 

Figure 3d schematically illustrates an edited output video sequence; 

Figures 4a to 4c schematically illustrate the logical relationship between clip icons, an edit decision list and data 
representing source video files; 

Figure 5 schematically illustrates cursor mapping within ah output area of the display screen of Figure 1 ; 
Figure 6 schematically illustrates a second type of cursor mapping within the output area of the display screen of 
Figure 1 ; 

Figures 7a to 7c schematically illustrate different cursor types during a drag and drop operation; 
Figures 8a and 8b schematically illustrate the use of the different cursor types; 

Figure 9 schematically illustrates a shuttle control operation in a viewer window of the display screen of Figure 1 ; 
and 

^Figure 1 0 is a schematic graph of shuttle speed against cursor displacement. 

Figure 1 is a schematic diagram of a display screen of an edit controller. The display screen will be described first 
to give an overview of the edit controller operation, and then the hardware and software underlying this wili be described 
further. In fact; much of Figure 1 has already been described above. 

The replay operation described above (initiated by clicking bh the viewer window) can be stopped by a single 
mouse click within the viewer window. The viewer window can also be used to control shuttle operation, in a manner 
to be described further below. 

It is possible for the user to re-order the clip icons to rearrange the order in which the clips are to be displayed in 
the edited output video sequence, in the present example, this can be achieved using the "drag-and-drop" mechanism 
similar to that which is standard to the Microsoft Windows version 3.1 operating system. Using this mechanism, the 
user can position the display screen cursor over a clip icon to be moved, and then press and hold the mouse button. 
If the cursor is then moved while the mouse button is pressed and held, the icon is "dragged" with the cursor to a new 
position. The mouse button is released to "drop" the clip icon at the new position. 

For example, the clip icon 30B could be dragged and dropped to a position between the clip icons 30C and 30D. 
Thus, the order of the clip icons on the display screen would become ACBD and the output edited sequence would 
comprise clip A followed by clip C, clip B and finally clip D. 

The output edited sequence can be viewed by the user as follows, if the user double-clicks on the clip icon 30A, 
then the whole of the portion A will be displayed, followed immediately by the whole of the portion B, then C and finally 
D. The composite sequence ABCD forms the edited output programme. 

If the user wishes to preview only, say, a latter part of the edited output programme, he could double-click on the 
clip icon 30C, in which case replay would start from the beginning of clip C, to be followed immediately by clip D. 

Further techniques for previewing the output sequence will be described below. 

Figure 2 is a schematic block diagram of the edit controller and associated video storage apparatus. 

The edit controller comprises a personal computer (PC) 1 00 running the Microsoft Windows 3. 1 operating system, 
the PC having a cursor control device 110 (e.g. a mouse), a display screen memory 120 and a display screen 130. 
The PC in the present embodiment is a notebook computer, the IBM Thinkpad 760C, in which the PC 100. the cursor 
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control device 110. video display screen memory 120 and the display screen 130 are all incorporated into a single 
portable unit (In actual fact, the cursor control device 100 in the IBM Thinkpad is a joystick control device, but s.nce 
this is set up to mimic the operation of a mouse, and an external mouse port is also available on this PC. the term 
•mouse' will be used for convenience as a generic term for a cursor control device in the following descnption.) 
s The PC 1 00 communicates with a video store controller 1 40 which in turn accesses video and audio data stored 

on a magneto-optical disc 150. In the present embodiment, the video store controller and the MO disc 150 are provided 

within- a-"docking stationi r i=e,a box of similar-size-to-the-fBM-Ttiinkpadror^whielvthe-IBM-Thinkpad may-rest 

In operation, a video signal is supplied at an input port 160 of the video store controller and is subjected to a high 
degree of intra-picture data compression for storage on the MO disc 150. When one or more sections of source video 
10 have been stored on the MO disc 150, they can be manipulated by the user operating the edit controller to generate 
an edit decision list which is a fist of time codes defining "in-points- and "out-points- of the source material for successrve 
portions of an output edited video sequence. The edit decision list can then be applied to the original video data as 
supplied to the video store controller 140. for broadcast or distribution. , 
Figures 3A to 3C schematically illustrate source video files, and Figure 3D schematically illustrates an edited output 
15 video sequence. In all of Figures 3A to 3D, time is represented on a horizontal axis from left to right. 

The output video sequence of Figure 3D is formed of successive portions or clips of the source files of Figures 
3B 3A and then 3C. These are joined together contiguously by "cut" edits. 

' In use in order to generate one of the clips from a source file, the user would replay that source file in the viewer 
window until a suitable in-point, t i(l was located, the user. would operate a particular key or click on a cursor control on. 
so the screen (not shown). The user would then continue the replay of the source file until a suitable out-point was found, 
and then operate the appropriate control to define that out-point. 

An entry in the edit decision list (see below) would then be created, along with a corresponding clip icon (see 
below). The newly created EDL entry and clip icon would be placed as a new temporally last item in the sequence of 
clips already prepared. However, this temporal order can easily be altered, as described below. 
ss Figures 4A to 4C schematically illustrate the logical relationship between clip icons 30, an edit decision list (Figure 

4B) and data representing the source video files (Figure 4A). 

Each of the schematic boxes 200 in Figure 4A represents a file header or directory entry for a file on the MO disc 
150 corresponding to a section of source video. The directory entry includes file information such as a title, a starting 
time code and a finishing timecode. Each such directory entry is associated with a single source icon 20 on the display 
30 screen of Figure 1 . " ' . , 

The boxes 210 of Figure 4B schematically illustrate entries in an edit decision list. Each such entry relates to one 
contiguous portion of the output video sequence derived from a single one of the source, video files. The entry contains 
information defining one of the source video files and a corresponding "Reel ID" defining the origin of the source file 
(e g a reel of video tape), an offset start variable defining the first picture of the sequence to be taken from that source 
35 video file a duration variable defining the duration of the portion to be used from that source video file, and two com- 
pressed pictures: an in picture and an out picture. These compressed pictures are accessed from the data correspond- 
ing to their source file stored on the MO, disc 150 when the EDL item is first created. 

All of the times relating to in-points, out-points . offsets and durations are expressed in the standard video timecode 
format HH:MM:SS:FF (hours: minutes: seconds: frames) 
40 The edit decision list for the example of Figures 3a to 3d therefore stores the following data: 
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EDL item 1 


File ID: B 

Reel ID: reel i 
offset (B) 




duration (B) 
* picture at . * 
picture at to Ut(B) 


EDL item 2 


File ID: A 
Reel ID: reel 2 
offset (A) 
duration (A) :> 
picture att^A, 
picture at C (A) 



EDL item 3 


File ID: C 




Reel ID: reel 3 




offset (G) 




picture at t^Q 




picture at 




^eu*r * Vonw b!"lo *: n-:> sterol? a n 



where duidtohCApi^e^tbtt&^r^tA^'*'''' ' , . ; ' . ' ''. ., . . ^ or 

On replay ol the output edited sequence, a linked list of storage locations on the disk is' created by the PG and 
transmitted to the video store controller to define the frames necessary for the output edited sequence. This linked list 
is also stored on ihe.diskso that it can be accessed later if required, even in a later "editing/session. • 

The same replay mechanism is used to replay a source file, in that a linked list of storage locations on the MO disk 
is derived by the PC 1O0 reference to the source file header and is transmitted to the video store controller, which then 
reads the frames at those storage locations in the appropriate order for replay. Shuttle replay is also possible by re- 
playing the frames at a higher rate or by replaying only, say, 1 in n of the frames to achieve the desired shuttle speed. 

To create the linked list of storage locations for an output edited sequence, first, the directory entry tor file B is 
accessed and the starting timecode of file B is read from the directory entry. The offset variable, off set(B) is added to 
the starting timecode to calculate an in-point for this clip. The duration variable. duratioh(B) is added to thetimecode 
of the in-point to calculate an out-point for the clip. The file address information stored in thedirectory entry (basically 
a linked list of data items or 'clusters* on the MO disk 150) is accessed to determine which cluster holds the picture 
corresponding to the required in-point. The appropriate cluster for the in-point picture is specified as the first cluster 
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,„ ,„„ om.n.clip. and. Mowing .h. linked m o, *»». dainty .h.di.ec.xv «u» «««. 

C,,P Ttact, in 000,0,00 with many existing uses of the ^-and^r^ 

b ' ed) At the end ol a drag-and drop operation, il the order of the dip teons has been changed, th.n the assignments 
directory entries in fact form a linked list, but this is not important to the £^f£3£ under the parent window 

Tthe user This allows the edit transition between that clip and the next to be rev.ewed by the user. 
The time at which to start (or cue up) replay is calculated as follows: 
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30 



replay start timecode = starting TC for output (virtual) file 
+ lengths ot preceding clips (if any) 
+ duration of current clip 



predetermined time period 



w However if the duration of the clip is less thanfoe predetermined time period.'replay is initiated from the start of the clip 
Fiqure 6 schematically illustrates a second type of cursor mapping within the output area of the display screen of 
Figure 1. Here, further regions are notionally defined by ranges of cursor coordinates, for use during a drag-and-drop 

^During such an operation, the cursor coordinates- (in the parent window) are continuously (repeatedly) checked 
is against coordinate ranges defining "left" regions and "right" regions 280 about each clip icon. In the example shown, 
one left region and one right region overlie each clip icon, and so during the drag and drop operation if the cursor is 
detected to be in either of those two regions, it is thereby detected that that is the nearest icon to the current cursor 

P ° Slt -Se left and right regions- can then be used to detect and indicate:which side of the detected nearest icon the 
20 dragged icon would fall, if released then. Basically, if the cursor is in a left region, the dragged icon would fall to the 
left of the detected nearest icon. If the cursor is in a right region, the dragged icon would fall to the r.ght of the detected 

nearest icon. j . « . . „« 

This detection can then be used to display an indication of which side of the detected nearest icon the dragged 

icon will fall. 

2S Fiqures .7a to 7c schematically illustrate different cursor types during a drag and drop operation. 

When the cursor is m a left region 270, the cursor is changed (using a standard Windows cursor Change routine) 
to the cursor of Figure 7a. Similarly, when the cursor is in a right region, the cursor ischanged to the cursor of Figure 
7b The cursor of Figure 7c indicates that the cursor is in neither a left: nor a right region (and indeed it may be outs.de 
the parent window), and so it is not a valid place to drop the dragged icon. II the icon is dropped there, then rt is either 
dropped at the end of the existing icon order (if still within the parent window) or the order of the < icons in the parent 

window will not change (if outside the parent window). » 
Fiqures 8a and 8b schematically illustrate the use of the different cursor types. 

In Fiqure 8a. the cursor is slightly to the left of an underlying clip icon 30. and so the left arrow cursor is displayed 
to give a clear indication tothe user that the dragged icon will fall to the left of the underlying icon. Similarly the situation 
is is reversed in Figure 8b. Thus a clear indication is given to the user of which side the dragged icon will fall. 

In an alternative embodiment, thearrow-like indication could be placed over the detected nearest icon, rather than 
using a modification of the cursor itself. , 

Figure 9 schematically illustrates a shuttle control operation in a viewer window of the display screen of Figure 1 . 
and Figure 10 is a schematic graph of shuttle speed against cursor displacement. > ; 

<o When the cursor is placed within the viewer window and the mouse button clicked and held, the viewer window 

initiates shuttle replaytof the video material currently associated with thetviewer window'(depehdin^on:theclast)icon 
selected by the user, this could bean:ou|po1vcip.otito8ouiice Vi6)i--<'.-<= 'sec: <?*•> V- '-^ ^T'^-^ « • ^ - ' 

In fact this is defined as a two-stage process. When the mouse button is first pressed within the viewer window, 
(whether or not it ,isrsubsequently.'held:.down). f the Windows -mouse down-: message'causes the Viewer, window to 
s issue a -stop- command to stop replay. Then, if the.mouse button has not been released within a predeterm.ned^me 
(e g 0 5 seconds), as detected by recording the Windows timer at the time of the first mouse down message, shuttle 
operation is selected. Alternatively, if a double click is detected (i.e. a release and then a second clickwith.n a prede- 
termined time) normal speed replay is initiated.by the viewer window. ■ 

The viewer window temporarily -captures* the mouse as long as the button is held down - a standard Windows 
j technique. The coordinates in the viewer window of the point at which the mouse button is first clicked (x,, y,) are stored, 
and the coordinates of the cursor at intervals thereafter (Xc, y c ) are compared wilh (x,, y,). 
The shuttle speed is set to be dependent on the current value:of: - 
!x c - x,! i e on the horizontal component 302 of the distance 300 from the initial activation point to the current 
cursor position. However, this value does not in itself specify the shuttle speed; instead, there is a generally exponential 
: relationship between the horizontal displacement component and the shuttle speed up to a maximum shuttle speed, 
as illustrated schematically in Figure 10. This relationship is achieved by the value .x c * Xj, actually providing an index 
into a look-up table (e.g. in read-only-memory) defining shuttle speed values in response to different honzontal dis- 
placement component values. 
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Claims 
1. 

is the controller comprising: 



2S 



qua! to say the width ol the viewer window 
„ s.,ec»a. CM** ™~ — » ^ ^ araJ 

controller comprising: 

, ,„: — , „ — * — ~ — — - 

4 Aneditcontrolleraccordingtoanyoneo1thepreced.n9C 

o, the corresponding clip .con. ^- Ith the second selection, area.is at .east..: 

P * vc. • *-< ">T-- J^^**^ area overlies anedgerefl»n ol the cone 

6. An edit c^^^^ac^gto^^^ ^ fo|towing clip icon. 

sponding clip icon and/or an edge region.o disDlavinq a respective 
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the cursor on the display screen when the selection control means is activated by the user; the method comprising: 



defining first and second display screen selection areas for each clip icon, the first display screen selection 
area having a predefined position on the display screen with respect to a current display position of the re- 
spective clip icon and the second display screen selection area having a predefined position with respect to 
a current display position of the respective clip icon and/or the next clip icon in the temporal replay order; 
iniliatingreplay of the-output material sequenee ; in response to user operation ofthe selection control means- 
while the cursor is displayed within the first selection area associated with a clip icon, from the start of the 
material clip corresponding to that clip icon; and _ . _ . - . * 

initiating replay of the output" material sequence, in response to user operation of the selection control means 
while the cursor is displayed within the* second selection area associated with a clip icon, from a point within 
the material clip corresponding to that clip icon which is" a predetermined time before the end of that material 
clip. 
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Fig. 5 
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Fig. 7a Fig. 7b 



Fig. 7c 




30 



Fig. 8a 



30 
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(57) An edit controller for controlling editing of re- 
corded audio and/or video material, in which temporally 
successive material clips of a edited output material se- 
quence are represented by corresponding clip icons on 
>fe display screen, comprises cursor control means for 
providing user control of a cursor on the display screen; 
selection control means for selecting an operation to be 
performed by the edit controller in dependence on the 
current position of the cursor on the display screen when 
the selection control means is activated by the user; 
means for defining first and second display screen se- 
lection areas (250,260) for each clip icon, the first and 
second display screen selection areas (250,260) each 
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having a predefined position on the display screen with 
respect to a current display position of i\he respective ' 
clip icon; means, responsive to user operation of the se- 
lection control means while the cursoris displayed with- 
in the first selection area (260) associated with a clip 
icon for initiating replay of the output material sequence 
from the start of the material clip corresponding to that 
clip icon; and means, responsive to user operation of 
the selection control means while the cursor is displayed 
within the second selection area (250) associated with 
a clip icon for initiating replay of the output material se- 
quence from a point within the material cl'p correspond- 
ing to that clip icon which is a predetermined time before 
the end of that material clip. 
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